Item order and speededness: implications for test fairness in higher educational high-stakes testing
نویسندگان
چکیده
A common approach to increase test security in higher educational high-stakes testing is the use of different forms with identical items but item orders. The effects such varied orders are relatively well studied, findings have generally been mixed. When multiple used, we argue that moderating role speededness on order cannot be neglected as missing responses commonly scored incorrect testing. If test-takers run out time while not giving answers easy at end test, they penalised stronger than if instead were unable provide difficult items. Using an illustrative real-data example a speeded show potential consequences ignoring can substantial respect fairness. Our proposed solution consists using fixed across from point which may become for some students. In this approach, most time-intensive placed test. simulation based real data two university examinations psychology students illustrates usefulness approach.
منابع مشابه
High stakes testing in higher education and employment: appraising the evidence for validity and fairness.
The authors review criticisms commonly leveled against cognitively loaded tests used for employment and higher education admissions decisions, with a focus on large-scale databases and meta-analytic evidence. They conclude that (a) tests of developed abilities are generally valid for their intended uses in predicting a wide variety of aspects of short-term and long-term academic and job perform...
متن کاملInterpreting the Validity of a High-Stakes Test in Light of the Argument-Based Framework: Implications for Test Improvement
The validity of large-scale assessments may be compromised, partly due to their content inappropriateness or construct underrepresentation. Few validity studies have focused on such assessments within an argument-based framework. This study analyzed the domain description and evaluation inference of the Ph.D. Entrance Exam of ELT (PEEE) sat by Ph.D. examinees (n = 999) in 2014 in Iran....
متن کاملDifferential Item Functioning (DIF) in Terms of Gender in the Reading Comprehension Subtest of a High-Stakes Test
Validation is an important enterprise especially when a test is a high stakes one. Demographic variables like gender and field of study can affect test results and interpretations. Differential Item Functioning (DIF) is a way to make sure that a test does not favor one group of test takers over the others. This study investigated DIF in terms of gender in the reading comprehension subtest (35 i...
متن کاملHigh-Stakes Testing: The Background Behind Testing-Based Educational Reforms and Implications for Practice by Speech-Language Pathologists
47 1092-5171/03/3001-0047 ABSTRACT: Some current educational reforms (U.S. Department of Education, 2002) focus on preparing students for mandated testing. The Individuals with Disabilities Education Act (IDEA, 1997) requires education agencies to provide students with disabilities with the opportunity to participate in testing. Speech-language pathologists face the challenge of helping student...
متن کاملHigh-Stakes Testing
I review the literature on the impact on student achievement of high-stakes testing. Its popularity as a mechanism for holding educators accountable has triggered studies to examine whether its promise to increase student learning has been fulfilled. The review concludes there is no consistent evidence to suggest high-stakes testing leads to increases in student learning. Some evidence suggests...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Assessment & Evaluation in Higher Education
سال: 2021
ISSN: ['0260-2938', '1469-297X']
DOI: https://doi.org/10.1080/02602938.2021.1991273